Attorney Docket No. 03-AG-008/AL 
Client .Matter No. 85696.0036 



METHODS AND APPARATUS FOR TEXTURE COMPRESSION 
AND COMPUTER PROGRAM PRODUCT THEREFOR 

5 BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to texture compression 
techniques . 

2 . Background of the Invention 

10 Compression and decompression intended to minimize 

the memory size needed to store 2D textures is a 
promising field of application for these techniques in 
the 3D graphic domain. This possible field of use is 
becoming more and more significant as the dimensions and 

15 number of these textures tend to increase in real 
applications. The level of detail tends to increase as 
required by some applications, such as 3D games, and, 
without the help of such techniques, memory size and 
bandwidth for access would tend to require increasing 

20 performance levels hardly sustainable in mobile, ultra 
low power, handheld systems. More to the point, these 
techniques are becoming increasingly important in 
wireless phone architectures with 3D games processing 
capabilities . 

25 For example, assuming a texture dimension of 512 x 

512 pixels 16 bit/color each and a depth of 3, the amount 
of memory needed is 1.5 M bytes. Assuming 20-30 frames 
per second, the memory bandwidth is 3 0 to 4 5 Mbytes/s. 

Additional background information on this topic can 
30 be gathered from "Real-Time Rendering" by Tomas Akenine- 
Moller and Eric Haines, A.K. Peters Ltd, 2 nd edition, ISBN 
1568811829. 
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A well-known solution in this scenario was developed 
by the company S3; the related algorithm is designated 
S3TC (where TC stands for Texture Compression) . 

This has become a widely used de-facto standard and 
5 is included in the Microsoft DirectX libraries with adhoc 
API support . 

Compression is performed off-line at system 
initialization and next the textures are stored in the 
main memory. Decompression processes act to decompress 
10 textures accessing the memory run- time when needed by the 
graphic engine. This means that only decompression is 
implemented in hardware form while compression is not. 

Important parameters for the decompression engine 
are: steps needed to decompress textures and possible 
15 parallel operation; low latency between data-access-f rom- 
memory and data-out-f rom the decompression engine. 

In order to better understand operation of the S3TC 
algorithm one may refer to an image in RGB format, where 
each color component R (Red) or G (Green) or B (Blue) is 
20 a sub- image composed by N pixels in the horizontal 
dimension and M pixels in vertical dimension. If each 
color component is coded with P bits, the number of bits 
per image is N*M*3*P. 

For example, assuming N=M=2 56 and P=8, then the 
25 resulting size is 1,572,864 bits. If each sub-image R or 
G or B is decomposed in non- over lapping blocks of Q 
pixels in the horizontal dimension and S pixel in the 
vertical dimension, the number of blocks per sub- image is 
(N*M)/(Q*S) while per image is [3 (NM/ (Q*S) ] and the 
30 number of bits per block is [3*(Q*S)]*P. If, for example 
q=S=4 and P=8, then the resulting size of each block is 
384 bits. If the number of bits per channel is R=5, G=6, 
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B=5 then the resulting size of each block per image is 
(4*4) * (5 + 6 + 5) =256 bits. The S3TC algorithm is able to 
compress such an amount of data by 6 times when R=8, G=8, 
B=8 and 4 times when R=5 , G=6, B=5 . 64 bits compose the 
5 resulting compressed block always sent to decompression 
stage. This number is the results of the coding steps 
described below assuming Q=S=4 . 

To sum up, operation of the S3TC algorithm may be 
regarded as comprised of the following steps: 
10 i) Decompose the RGB image in non- overlapped 

(Q=4)*(S=4) blocks of R G B colors 

ii) Consider the following block composed by 16 
pixels each one composed by R, G and B color components: 

Pij = Rij U Gij U Bij (this denotes the pixel at the 
15 ij position the RGB image, and U is the union operator) 
(Rll Gil Bll) (R12 G12 B12) (R13 G13 B13) (R14 G14 B14) 
(R21 G21 B21) (R22 G22 B22) (R23 G23 B23) (R24 G24 B24) 
(R31 G31 B31) (R32 G32 B32) (R33 G33 B33) (R34 G34 B34) 
(R41 G41 B41) (R42 G42 B42) (R43 G43 B43) (R44 G44 B44) 
20 iii) Decompose the block above in three sub-blocks 

called sub-block R, sub-block G and sub-block B as shown 
herein below, each block including only one color 
component : 
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Bll B12 B13 B14 sub-block B 
B21 B22 B23 B24 
B31 B32 B33 B34 
B41 B42 B43 B44 

as shown in figure 1. Specifically, figure 1 shows RGB 
blocks ordered in different planes, with a RGB block 
shown on the left and a corresponding de- compos it ion 
shown on the right . . 

iv) Sort in ascending order each sub-block color 



v) Detect the black color, which is a pixel made of 
R=0 and G=0 and B=0 

15 

vi) If the black color is not detected, then set a 
color palette made by 



a. 1st color is the minimum value of sub-block 
20 R (min_R) , minimum value of sub-block G (min__G) , 

minimum value of sub-block B (min_B) . 

b. 2nd color is the maximum value of sub-block 
R ( max_R ) , maximum value of sub-block G (max_G) , 

25 maximum value of sub-block B ( max_B ) 

c. 3 rd (Intl) is composed by (2*min R+max R) /3 
(IntlR) , (2*min G+max G) /3 (IntlG) , (2*min B+max 
B)/3 (IntlB) 



30 



d. 4 th (Int2) is composed by (min R+2*max R) /3 
(Int2R) , (min G+2*max G) /3 (Int2G) , (min B+2*max 
B)/3 (Int2B) 
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vii) Otherwise, if black color is detected then set 
a color palette made by 



5 a. 1 st color is minimum value of sub-block R 

(min_R) , sub-block G (min_G) , sub-block B (min_B) 
where each of them must not be equal to zero (the 
black color component) at the same time 

10 b. 2 nd color is maximum value of sub-block R 

( max_R ) , sub-block G ( max__G ) , sub-block B ( max_B ) 

c. 3 rd (Intl) is composed by (min R+max R)/2 
(IntlR) , (min G+max G) /2 (IntlG), (min B+max B) /2 

15 (IntlB) 

d. 4 th is the black color that has R,G,B 
components equal to zero 

20 viii) If black color is not detected define the 

look-up color palette as 

Look-up table = [ Min_R, IntlR, Int2R, Max_R] 

[ Min_G, IntlG, Int2G, Max_G] 
25 [ Min__B, IntlB, Int2B, Max_B] 

If black color is detected define the color palette 

as 

30 Look-up table = [ MinR, IntlR, MaxR 0] 

[ MinG, IntlG, MaxG 0] 
[ MinB, IntlB, MaxB 0] 
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ix) Associate the following 2 bits code (in 
boldface, under the palette) to each column of the above 
palette 



Look-up table = 



[ MinR, IntlR, Int2R, MaxR] 

[ MinG, IntlG, Int2G, MaxG] 

[ MinB, IntlB, Int2B, MaxB] 

00 01 10 11 



10 Look-up table = [ MinR, IntlR, MaxR 0] 

[ MinG, IntlG, MaxG 0] 

[ MinB, IntlB, MaxB 0] 

00 01 10 11 



15 x) For each Pij = Rij U Gij U Bij (where i ranges from 

1 to Q=4 and j ranges from 1 to S = 4) compute the 
Euclidean distance Dist between it and each look-up color 
as defined above in vi.a,b,c,d or vii.a,b,c,d depending 
if black color has been detected or not. Essentially this 

20 is the Euclidean distance between two points in a three- 
dimensional coordinate space. Also, the difference is 
within a homologous color component (between R or G or 
B) . 



25 Distl = V( | Rij -MinR | 2 +| Gij -MinG | 2 +|Bij -MinB | 2 ) 

Dist2 = V( iRij-IntlR^+lGij-IntlG^+lBij-IntlB) 2 ) 

Dist3 = V( |R ij -Int2R| 2 +|G ij -Int2G| 2 +|B ij -Int2B| 2 ) 

Dist4 = V( | Rij -MaxR | 2 + | Gij -MaxG | 2 + | Bij -MaxB | 2 ) 



30 xi) For each Pij = Rij U Gij U Bij find the minimum 

distance among Distl, Dist2, Dist3 and Dist4 . For example 
let it be Distl. 
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xii) Send to a decoder process the code associated 
to the color enclosed in the look-up table that has the 
minimum distance. If it is Distl then the code is 00. 

xiii) The decoder receives for each Q*S block as 
shown in figure 2 

a. a two-bit code for each Pij that are 
addresses to the look-up table 

b. MinR MinG MinB 

c . MaxR MaxG MaxB 

xiv) If Min is received before Max by the decoder 
then black has been detected by the encoder otherwise not 

xv) As shown in figure 2 , the decoder operates as 
described in steps vi or vii depending on black color 
detection, computing 

a. IntlR IntlG IntlBand Int2R Int2G Int2B if 
black color is not detected by encoder 

otherwise 

b. IntlR IntlG IntlB if black color is detected 
by encoder 

xvi) As shown in figure 2, the decoder addresses a 
look-up table with 2 bits code associated to each Pij and 
replaces it with the color stored in the look-up table 
color palette. Specifically ST, LUT, and CT indicate the 
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7 



source text, the look-up table, and the compressed text, 
respectively. 

Figure 3 shows how the data sent to the decoder are 
arranged in a bitstream and if the black color is not 
5 detected, while figure 4 shows the opposite case. 

As stated before, the compression ratio is 6:1 or 
4:1. This is because if colors are in R=8 G=8 B=8 format 
then 384 bits are coded with 64 (384/64=6) and if colors 
are in R=5 G=6 B=5 format then 256 bits are coded with 64 
10 (256/64=4) . 

As shown in figure 3 and 4, the sum of all the bits 
amounts to 64 . 

SUMMARY OF THE INVENTION 

However satisfactory the prior art solution 
15 considered in the foregoing may be, the need is felt for 
alternative texture compression/decompression techniques 
of improved quality. 

The aim of the present invention is thus to provide 
such an alternative, improved technique, leading to 
20 better performance in terms of quality achieved and 
complexity needed for its implementation. 

According to the present invention, such an object 
is achieved by means of a method having the features set 
forth in the claims that follow. The invention also 

25 encompasses the decoding process as well as corresponding 
apparatus in the form of either a dedicated processor or 
a suitably programmed general -purpose computer (such as a 
DSP) . In that respect the invention also relates to a 
computer program product directly loadable into the 

30 memory of a digital computer such as a processor and 



\\\DE - 85696/0001 - 197229 v3 



including software code portions performing the method of 
the invention when the product is run on a computer. 

The preferred embodiment of the invention provides a 
significant improvement over prior art solutions such as 
S3TC from different viewpoints, since it uses the 
following compression tools: 

color prediction, 

color- de- correlation, 

sorting of the prediction errors, 

generation of the look-up table, 

bitstream packing, and 

decoding process. 

These tools are different from those used in S3TC or not 
even provided in S3TC. 

BRIEF DESCRIPTIONS OF THE DRAWINGS 

The invention will now be described, by way of 
example only, with reference to the annexed figures of 
drawing, wherein: 

Figures 1 to 4 , pertaining to the prior art, have 
already been described in the foregoing, 

Figure 5 shows a R or G or B sub-block sorted from 
left to right in ascending order in a possible embodiment 
of the invention; 

Figure 6 is a block diagram of a pipeline 

arrangement to evaluate the performance of the 

compression and decompression techniques described 
herein; 
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Figures 7a to 7h are diagrams showing the directions 
used to scan and predict pixels in the arrangement shown 
herein; and 

Figures 8 and 9 show additional details of possible 
5' embodiments of the arrangement described herein. 

DETAILED DESCRIPTION 

A first embodiment of the invention will now be 
described by using the same approach previously adopted 
for describing, in the case of Q=S=4, the S3TC 
10 arrangement . 

This method will first be described by referring to 
an exemplary embodiment where Q=S=3 . 

i) Decompose the RGB image in non-overlapped QxS 
15 blocks of R G B colors 

ii) Consider the following 3x3 block composed by 
nine pixels each one composed by R, G and B components: 

20 Pij = Rij U Gij U Bij (where Pij again denotes the pixel 

placed in the ij position in the RGB image, and U is 
the union operator) 

(Rll Gil Bll) (R12 G12 B12) (R13 G13 B13) 
25 (R21 G21 B21) (R22 G22 B22) (R23 G23 B23) 

(R31 G31 B31) (R32 G32 B32) (R33 G33 B33) 

iii) Decompose the above block in three sub-blocks 
called sub-block R, sub-block G and sub-block B, 

30 respectively, as shown below, wherein each block includes 
only a color component : 
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iv) Define a 1st predictor for each sub-block 

a. R22 as prediction for all colors in the same 
sub-block R excluding R22 

b. G22 as prediction for all colors in the same 
sub-block G excluding G22 

c. B22 as prediction for all colors in the same 
sub-block B excluding B22 

v) Compute for each sub-block the following 
prediction differences : 

a. Sub-block R 

25 i. (R22-R11) , (R22-R12) , (R22-R13) , (R22-R21) , (R22- 

R23) , (R22-R31) , (R22-R32) , (R22-R33) 

b. Sub-block G 

i. (G22-G11) , (G22-G12) , (G22-G13) , (G22-G21) , (G22- 
30 G23) , (G22-G31) , (G22-G32) , (G22-G33) 

c. Sub-block B 



15 



20 
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i. (B22-B11) , (B22-B12) , (B22-B13) , (B22-B21) , (B22- 
B23) , (B22-B31) , (B22-B32) , (B22-B33) 



vi) Sort in ascending order the prediction 
5 differences in each sub-block as shown in figure 5: 

specifically, the figure shows R or G or B sub-block 
prediction differences sorted from left to right in 
ascending order; each number is the position in ascending 
order that addresses each prediction difference. 

10 

vii) Set up a look-up prediction difference palette 
wherein 

a. 1 st value is the minimum for the prediction 
differences in sub-block R. The same applies for the 

15 prediction differences in sub-blocks G and B, thus 

yielding min_errorR, min_errorG, min_errorB. 

b. 2 nd value is the maximum for the prediction 
differences in sub-block R. The same applies for the 
prediction differences in sub-blocks G and B thus 

20 yielding max_errorR, max__errorG, max_errorB . 

c. 3 rd is Intl composed by 

i . IntlR= (2*min_errorR+max_errorR) /3 , 
IntlG= (2*min_errorG+max_errorG) /3, 
IntlB= (2*min_errorB+max_errorB) /3 
25 d. 4 th is Int2 composed by 

i . Int2R= (min_errorR+2*max_errorR) /3 
Int2G= (min__errorG+ 2*max_errorG) /3 , 
Int2B= (min_errorB+2*max_errorB) /3 

30 (In fact the relationships reported in the foregoing 

correspond to the presently preferred choice within the 
general relationships : 
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Intl (R, G, B) 

= (a*min_errorR+b*max_errorR) / (a+b) , 
(c*min_errorG+d*max_errorG) / (c+d) , 
(e*min_errorB+f *max_errorB) / (e+f ) , 

5 

Int2 (R, G, B) 

= g*min_errorR+h*max_errorR) / (g+h) , 
(i*min_errorG+l*max_errorG) / (i+1) , 
(m*min_errorB+n*max_errorB) / (m+n) 

10 

where a, b, c, d, e, f, g, h, i, 1, m, and 
n are weighing factors) . 

viii) Define a look-up prediction error palette 
15 as 

Look-up table= 

[Min^errorR, IntlR, Int2R, Max^errorR] 

[Min^errorG, IntlG, Int2G, Max_errorG] 

[Min^errorB, IntlB, Int2B, Max^errorB] 

20 

ix) Associate the following 2 bit code with each 
column of the above palette 



Look-up table = 

25 [Min_errorR / IntlR, Int2R, Max_errorR] 

[Min_errorG, IntlG, Int2G, Max_errorG] 

[Min_errorB, IntlB, Int2B, Max_errorB] 

2 BIT CODE = 00 01 10 11 



30 x) For each Pij = Rij 

1 to Q=3 and j ranges 
prediction error using P22 



U Gij U Bij (where i ranges from 
from 1 to S = 3) compute the 
as predictor. 
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a. The prediction error is defined as Eij 
U E Gij U E Bij = (R 2 2-Rij) U (G 22 -Gij) U (B 22 -Bij) 



= E Rij 



xi) For each Eij compute the Euclidean distance 
5 between it and each look-up color as defined above in 
step ix. This is again the Euclidean distance between two 
points in a three-dimensional coordinate space and the 
difference is between homologous prediction error 
components . 

10 

Distl = V ( | E Ri:j -Min_errorR| 2 + | E G ij -Min_errorG | 2 + 
| EBij -Min_errorB | 2 ) 

Dist2 = V( |E Rij -IntlR| 2 + | E Gij - Int 1G | 2 + | E Bij - IntlB | 2 ) 
Dist3 = V( |E Rij -Int2R| 2 + | E Gij - Int2G | 2 + | E B ij - Int2B | 2 ) 
15 Dist4 = V ( | E Ri j-Max_errorR| 2 + | E Gij -Max__errorG | 2 + 
| E B ij-Max_errorB | 2 ) 



xii) For each Eij=E Ri j U E G ij U E Bi j find the minimum 
distance among Disti, Dist2, Dist3 and Dist4 . For example 
20 this may be Distl. 



xiii) Compose a bitstream as follows: 

a. P22 color = 16 bits 

b. P2 2+Min_error = 16 bits (= P2 2R+min_errorR U 
25 P22G+min_errorG U P2 2B+min_errorB) 

c . P22+Max_error =16 bits (= P2 2R+max_errorR U 
P2 2G+max_errorG U P22B+max_errorB) 

d. For each P n , P 12/ P 13/ P 2 i/ P 2 3, P31, V32, P33 a 
2 bits code is associated following steps 11, 12, 

30 13. For example if Distl is the minimum distance for 

Pij then the code associated and transmitted to it is 
00. 
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xiv) Each 3*3 block in encoded to 16+16+16+ (8*2 ) =64 
bits instead of 144 bits with a compression factor of 
2.25 if the RGB source format is 565. The value 3.375 if 
the RGB source format is 888. 

In the decoding process, the decoder will receive 
the incoming bitstream and proceed through the following 
steps : 

a. Get P22 

b. Get P22+Min_error (= P22R+min_errorR U 
P22G+min_errorG U P22B+min_errorB) 

c. Get P22+Max_error (= P2 2R+max_errorR U 
P2 2G+max_errorG U P22B+max_errorB) 

d. Then compute Min_error and Max_error 
inverting formula described in the above steps 
a,b for each color R, G, B as 

i. Min_error = (P22+Min_error) -P22 

ii. Max_error = (P2 2+Max_error) -P22 

e. Next compute look-up prediction error 
palette as per step vii) c,d and viii) 

f. Use 2 bit code to address look-up table 
and adding the value (thus addressed) to P22 to 
recreate each Pij 

The arrangement disclosed in the foregoing has been 
implemented for the following standard images and using 
two formats: RGB 565 and RGB 888, where 5, 6 or 8 are the 
number of bits per color channel . 

1. 256x256 (horizontal x vertical size dimension) 

• Abstrwav 

• Bricks 

• Bricks2 
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15 



• Chapt 

• Forest 

• ImageO 

• Intel 

5 • Pixtest 

• Reference 

• Rov 

• Teleport 

• Topsmap 

10 

2. 512x512 (horizontal x vertical size dimension) 

• Donut 



3. 640x480 (horizontal x vertical size dimension) 
15 • Balloon 

• DragonFly 

• Paper 

• Particles 

• Sparkle 

20 

These pictures are a representative set on which 
typically texture compression is applied. All pictures 
are in true-color format or 888, while the 565 are 
obtained from 888 truncating the 323 lowest bits of the 
25 888 pictures. Alternative truncating methods can be used 
to transform 888 pictures into 565 pictures such as 
"rounding to nearest integer" , "Floyd-Steinberg 
dithering" etc. These alternatives do not entail changes 
to the arrangement disclosed herein. 

30 To measure the performance of each algorithm, visual 

assessments and objective measures were performed, by 
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taking two parameters as the reference measures, namely- 
mean square error (MSE) and peak signal/noise ratio 
(PSNR) for each RGB channel. 

Figure 6 shows how measurements are carried out in 
5 the simulation environment. 

Input images IS in the 888 format (called Source888) 
are converted at 200 into the 565 format (called 
Source565) , then compressed at 201 and further 
decompressed at 202 to the 565 format. These images are 
10 back converted at 2 03 into the 888 format to generate a 
first set of output images OS' (also called Decoded888) . 

The Source- 565 images from block 2 00 are back 
converted into the 888 format at 204 to generate a second 
set of output images OS' ' to be used as a reference 
15 (called Source565to888 ) . 

A first set of PSNR values (called PSNR 888) are 
computed between the Source 888 IS and the Decoded888 OS' 
images. A second set of PSNR (called PSNR 565) values 
are computed between the Source565to888 OS' ' and the 
20 Decoded888 OS' images . 

The 565 images are back reported to the 888 format 
by simple zero bit stuffing of the 323 least important 
positions. 

How the Source888 IS images are converted to the 
25 565 foramt and back to the 888 format corresponds to 
conventional techniques that do not need to be described 
in detail herein. 

Mean squared (MSE) and peak (PSNR) error are defined 
as follows: 

30 MSE = (I| Pij -Paij | 2 ) / (w * h) where: 

Pij=source color 
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Pai j =processed color, after coding and decoding 
w, h= image width, height 

PSNR = 10 logio [ (2 bpp -l) 2 /MSE] where: 
5 bpp = bit per color 

Due to its predictive nature, the arrangement 
previously described is almost invariably able to achieve 
better performance, while yielding a lower compression 
ratio than S3TC. 

10 The proposed arrangement can be easily extended to 

Q=4xS=4 blocks by simply adding one more column at the 
right side and one more row at the bottom side of the 
Q=3xS=3 "chunk" . 

The main difference with respect to the embodiment 
15 described in the foregoing is related to the possibility 
of adopting a plurality of different patterns for 
extending the 3x3 block to a 4x4 block as best shown in 
figure 7 of the drawing. 

This extension will be described in the following. 

20 

i) Decompose the RGB image in non overlapped QxS 
blocks of R G B colors 

ii) Consider the following Q=4xS=4 block composed of 
25 16 pixels each one composed by R, G and B components: 

P ij= R i:j u Gij U Bij (where Pij is again the pixel at the 
ij position in the RGB image, and U is the union 
operator) 

30 

(Rll Gil Bll) (R12 G12 B12) (R13 G13 B13) (R14 G14 B14) 
(R21 G21 B21) (R22 G22 B22) (R23 G23 B23) (R24 G24 B24) 
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(R31 G31 B31) (R32 G32 B32) (R33 G33 B33) (R34 G34 B34) 
(R41 G41 B41) (R42 G42 B42) (R43 G43 B43) (R44 G44 B44) 



iii) Decompose the above block in three sub-blocks 
5 called sub-block R, sub-block G and sub-block B, 
respectively, as shown below, wherein each block includes 
only a color component 

Rll R12 R13 R14 sub-block R 

10 R21 R22 R23 R24 

R31 R32 R33 R34 

R41 R42 R43 R44 

Gil G12 G13 G14 sub-block G 

15 G21 G22 G23 G24 

G31 G32 G33 G34 

G41 G42 G43 G44 

Bll B12 B13 B14 sub-block B 

20 B21 B22 B23 B24 

B31 B32 B33 B34 

B41 B42 B43 B44 



25 



iv) Define a 1 st predictor for each sub-block 



g. R22 as prediction for 3x3 colors surrounding 
R22 (i.e. Rll, R12, R13, R21, R23, R31, R32, R33) 

h. G22 as prediction for 3x3 colors surrounding 
G22 (i.e. Gil, G12, G13, G21, G23, G31, G32, G33) 

30 i. B22 as prediction for 3x3 colors surrounding 

B22 (i.e. Bll, B12, B13, B21, B23, B31, B32, B33) 
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See, in that respect, figure 7a , where this 
prediction pattern is represented geometrically. 



v) Define 

5 

j . a 2 nd set of predictors (see figure 7b) 
where : 

i. R23 as prediction for R14 R24 R34 
10 ii. R32 as prediction for R41 R42 R43 

iii. R33 as prediction for R44 

iv. G23 as prediction for G14 G24 G34 

v. G32 as prediction for G41 G42 G43 
15 vi . G33 as prediction for G44 

vii. B23 as prediction for B14 B24 B34 

viii. B32 as prediction for B41 B42 B43 

ix. B33 as prediction for B44 

20 

k. or a 3 rd set of predictors (see again the 
pattern shown in figure 7a) with 

i. R13 as prediction for R14 

ii . R23 as prediction for R24 

25 iii. R33 as prediction for R34 R44 R43 ■ 

iv. R31 as prediction for R41 

v. R32 as prediction for R42 

vi . G13 as prediction for G 14 

vii. G23 as prediction for G24 

30 viii. G33 as prediction for G34 G44 G43 

ix. G31 as prediction for G41 

x. G32 as prediction for G42 

xi . B13 as prediction for B14 
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xii. B23 as prediction for B24 

xiii. B33 as prediction for B34 B44 B43 

xiv. B31 as prediction for B41 

xv. B32 as prediction for B42 

5 

It will be appreciated that other prediction 
patterns are feasible, as shown in figures 7c to 7h. 

vi) Compute for each sub-block the following 
10 prediction differences: 

1. Sub-block R 

i. (R22-R11) , (R22-R12) , (R22-R13) , (R22- 
R21) , (R22-R23) , (R22-R31) , (R22-R32) , (R22- 

15 R33) 

ii. and the differences between predictors 
as defined in step v.j and v.k and related 
homologous colors 

m. Sub-block G 

20 i. (G22-G11) , (G22-G12) , (G22-G13) , (G22- 

G21) , (G22-G23) , (G22-G31) , (G22-G32) , (G22-G33) 

ii. and the differences between predictors 
as defined in step v.j) and v.k) and related 
homologous colors 

25 n. Sub-block B 

i. (B22-B11) , (B22-B12) , (B22-B13) , (B22- 
B21) , (B22-B23) , (B22-B31) , (B22-B32) , (B22-B33) 

ii. and the differences between predictors 
as defined in step v.j) and v.k) and related 

30 homologous colors 

o. From this point onwards, up to 8 full 
encodings of the block will run in parallel 
depending on the set of predictors used (since up to 
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8 prediction configurations are possible) . At the 
end of the 8 encodings the arrangment disclosed 
herein will compute the MSE between block before and 
after each encoding (out of 8 possible) . The one 
5 with the minimum MSE will be selected to generate 

the bitstream that will be sent to the decoder. 



vii) Sort in ascending order the prediction 
differences for each sub-block as shown in figure 8. Each 
10 number is the position that addresses each prediction 
differences in ascending order. Specifically, figure 8 
shows R or G or B sub-block prediction differences sorted 
from left to right in ascending order 

15 viii) Two groups are defined by the sorted 

prediction differences. The first is composed by the 
three lowest elements and the second by the three highest 
as shown in figure 8 . 



20 ix) Set a look-up prediction differences palette 

composed as follows: 

e. 1 st value is the median of the 1st group as 
defined in step 8 for sub-block R prediction 
differences. The same applies for sub-block G and B, 

25 thus yielding min_jnedian_errorR, min__median_errorG, 

min_median_errorB . 

f. 2 nd value is the median of the 2 nd group as 
defined in step 8 for sub-block R prediction 
differences. The same applies for sub-block G and B, 

30 thus yielding max_median_errorR / max_median_errorG , 

max_median_errorB . 

g. 3 rd is Intl composed by 
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i . IntlR= (2*min_median_errorR+max__median_error) /3 , 
IntlG= (2*min_median_errorG+max_median_errorG) /3 , 
IntlB= (2*min_median_errorB+max_median__errorB) /3 

5 

h. 4 th is Int2 composed by 

i . Int2R= (min_median_errorR+2*max_median_errorR) /3 , 
Int2G= (min_median_errorG+2*max_median_errorG) /3 , 
10 Int2B= (min_median_errorB+2*max_median_errorB) /3 

In figure 9 the groups and the two representative 
colors for each R, G, B sub-block are shown. 

(In fact the relationships reported in the foregoing 
15 correspond to the presently preferred choice within the 
general relationships : 

Intl (R, G, B)= 

20 (a*min_median_errorR+b*max_median_errorR) / (a+b) , 

(c*min_median__errorG+d*max_median_errorG) / (c+d) , 

(e*min_median_errorB+f *max_median_errorB) / (e+f ) , 

25 

Int2 (R, G, B) = 
(g*min_median_errorR+h*max_median_errorR) / (g+h) , 
30 (i*min_median_errorG+l*max__median_errorG) / (i + 1) , 

(m*min_median_errorB+n*max_median_errorB) / (m+n) 
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where a, b, c, d, e, f, g, h, i, 1, m, and 
n are weighing factors) . 

x) Define the look-up prediction error palette as 
5 Look-up table = 

[Min_median_errorR / IntlR, Int2R, Max_median_errorR] 
[Min_median_errorG, IntlG, Int2G, Max_median_errorG] 
[Min_median_errorB , IntlB, I nt 2 B , Max^med i an_e r r or B ] 

10 xi) Associate the following 2 bits code with each 

column of the above palette 
Look-up table = 

[Min_median_errorR, IntlR, Int2R / Max_median_errorR] 
[Min_median_errorG, IntlG, Int2G, Max_median_errorG] 
15 [Min_median_errorB, IntlB, Int2B, Max_median_errorB] 

2 BITS CODE = 00 01 10 11 

xii) For each Pij = Rij U Gij U Bij (where i ranges 
20 from 1 to Q=4 and j ranges from 1 to S=4) compute the 

prediction error using predictors as defined in steps v 
and vi . 

p. Define the prediction error Eij = E Ri j U E G ij U E B ij 
25 = (PredictorR kl -Rij) U (PredictorG k i-Gij ) U (PredictorB ki - 
Bij) 

xiii) For each Eij compute the Euclidean distance 
between it and each look-up color as defined above in 

30 step ix. This is again the Euclidean distance between two 
points in a three-dimensional coordinate space and the 
difference is between homologous prediction error 
components . 
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Distl=V ( I E R ij -Min_median_errorR | 2 + | E G ij - 
Min_median_errorG | 2 + | EBj -Min_median_errorB | 2 ) 
Dist2 =V ( | E Rij - Int 1R | 2 + | E Gij - Int 1G | 2 + | E Bij - Int IB | 2 ) 
5 Dist3=W ( | E Rij -Int2R | 2 + | E Gi j-Int2G | 2 + | E Bij -Int2B | 2 ) 
Dist4=V ( | E R ij-Max_median_errorR| 2 + | E G ij- 
Max_median_errorG | 2 + | E B ij -Max_median_errorB | 2 ) 

xiv) For each Eij = E R ij U E Gi j U E B ij find the minimum 
10 distance among Distl, Dist2, Dist3 and Dist4. For 

example, this may be Distl, and the two-bit code 
associated thereto is 00. 

xv) Each Q*S block is fully coded in 8 different 
15 sessions, where in each session uses one of the 8 

configurations for the predictions shown in figures 7a to 
7h: 

a. decode as per steps from xvi) below onward 
each of these 8 coded blocks 
20 b. for each decoded block and for each color 

component R, G or B compute the sum of squared 
differences between decoded colors and source ones 
(the one before their encoding) 

c. add the 3 numbers computed during step xv.b 
25 and find the minimum between the 8 options 

xvi) Compose a bitstream as follows: 
q. P22 color = 16 bits 

r. P22+Min_median_error = 16 bits 
30 (= P22R+Min_median_error U 

P22G+Min median errorG U P22B+Min median errorB) 
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s. P2 2+Max_median_error = 16 bits (= 
P2 2R+Max_median_error U P22G+ Max_median_errorG U 
P22B + Max_median_errorB) 

t. For each P n , P i2 , P13, Pi4, P21/ P23/ P24, P31, 
5 P32/ P33/ P34/ P41/ P42, P43/ P44 a 2 bits code is 

associated following steps iv) , v.j) or v.k), vi) , 
xii) , xiii) , xiv) . 

u. One of the 8 options (encoded with 3 bits) 
as per step xv.c. will be coded in this way 
10 i. 2 more bits are added to the bitstream 

ii. 1 virtual bit is coded putting 
P22+Min_median_error before or after 

P22+Max_median_error inside the bitstream 

xvii) For each block send the bitstream as defined 
15 in step xvi) to a decoder process. 

xviii) Each QxS=4*4 block in encoded to 
16 + 16 + 16+ (15*2) +2 = 80 bits = 16*5 = 10 bytes instead of 
256 bits allows a compression factor of 3.2 if the RGB 
source format is 565. It is 4.8 if the RGB source format 

20 is 888. 

In the decoding process, the decoder receives the 
incoming bitstream and performs the following steps: 
v. getP22 

w. get P2 2+Min_median_error after 

25 P22+Max_median_error or P22+Min_median_error before 

P22+Max_median_error : in this way the virtual bits 
as per step xvi.u.ii) are retrieved) 

x. get 2 more bits that with the virtual bits 
will build the 3 bits as per step 16. u to select how 
30 to make the prediction by resorting to one of the 

patterns adrressed by these three bits as shown in 
figure 7a to 7h 
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y. Then compute Min_median_error (step xix.w- 
P2 2) and Max_median_error (step xix . w-P22 ) 

z. Next compute look-up prediction error 
palette as per step 9 
5 aa . Use 2 bit code to address look-up table and 

adding the value stored at this address to P22 as 
defined in step 4 to recreate each Pij 

bb. Use colors decoded at step xix.aa as 
predictors (like defined in step v) 
10 cc. Use 2 bit code to address the look-up table 

and adding the value stored at this address to 
predictors defined in xix.bb) to recreate each 
remaining color 

The arrangement just described has been implemented 
15 the same set of pictures defined previously. The results 
show that the instant predictive arrangement is able to 
achieve at least the same performance levels of S3TC and 
yields a compression factor slightly lower than S3TC on 
565 sequences . 

20 The proposed arrangement however achieves 

unquestionably better quality in the both the 3x3 and 4x4 
versions, in spite of a lower compression ratio (i.e. in 
4x4 reaches 80% of performance of S3TC) . Even when worse 
quality has been measured, visual assessments showed 

25 imperceptible artifacts. 

Of course, without prejudice to the underlying 
principle of the invention, the details and embodiments 
may vary, also significantly, with respect to what has 
been described and shown by way of example only, without 
30 departing from the scope of the invention as defined by 
the annexed claims. 
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